FaceFilter: Audio-visual speech separation using still images

The objective of this paper is to separate a target speaker's speech from a mixture of two speakers using a deep audio-visual speech separation network. Unlike previous works that used lip movement on video clips or pre-enrolled speaker information as an auxiliary conditional feature, we use a single face image of the target speaker. In this task, the conditional feature is obtained from facial appearance in cross-modal biometric task, where audio and visual identity representations are shared in latent space. Learnt identities from facial images enforce the network to isolate matched speakers and extract the voices from mixed speech. It solves the permutation problem caused by swapped channel outputs, frequently occurred in speech separation tasks. The proposed method is far more practical than video-based speech separation since user profile images are readily available on many platforms. Also, unlike speaker-aware separation methods, it is applicable on separation with unseen speakers who have never been enrolled before. We show strong qualitative and quantitative results on challenging real-world examples.Comment: Under submission as a conference paper. Video examples: https://youtu.be/ku9xoLh62

P-TEFb Regulates Transcriptional Activation in Non-coding RNA Genes

Many non-coding RNAs (ncRNAs) serve as regulatory molecules in various physiological pathways, including gene expression in mammalian cells. Distinct from protein-coding RNA expression, ncRNA expression is regulated solely by transcription and RNA processing/stability. It is thus important to understand transcriptional regulation in ncRNA genes but is yet to be known completely. Previously, we identified that a subset of mammalian ncRNA genes is transcriptionally regulated by RNA polymerase II (Pol II) promoter-proximal pausing and in a tissue-specific manner. In this study, human ncRNA genes that are expressed in the early G1 phase, termed immediate early ncRNA genes, were monitored to assess the function of positive transcription elongation factor b (P-TEFb), a master Pol II pausing regulator for protein-coding genes, in ncRNA transcription. Our findings indicate that the expression of many ncRNA genes is induced in the G0–G1 transition and regulated by P-TEFb. Interestingly, a biphasic characteristic of P-TEFb-dependent transcription of serum responsive ncRNA genes was observed: Pol II carboxyl-terminal domain phosphorylated at serine 2 (S2) was largely increased in the transcription start site (TSS, -300 to +300) whereas overall, it was decreased in the gene body (GB, > +350) upon chemical inhibition of P-TEFb. In addition, the three representative, immediate early ncRNAs, whose expression is dependent on P-TEFb, metastasis-associated lung adenocarcinoma transcript 1 (MALAT1), nuclear enriched abundant transcript 1 (NEAT1), and X-inactive specific transcript (XIST), were further analyzed for determining P-TEFb association. Taken together, our data suggest that transcriptional activation of many human ncRNAs utilizes the pausing and releasing of Pol II, and that the regulatory mechanism of transcriptional elongation in these genes requires the function of P-TEFb. Furthermore, we propose that ncRNA and mRNA transcription are regulated by similar mechanisms while P-TEFb inhibition unexpectedly increases S2 Pol II phosphorylation in the TSSs in many ncRNA genes.One Sentence Summary: P-TEFb regulates Pol II phosphorylation for transcriptional activation in many stimulus-inducible ncRNA genes

Toll-like receptor 2 downregulation and cytokine dysregulation predict mortality in patients with Staphylococcus aureus bacteremia

Background Staphylococcus aureus bacteremia (SAB) presents heterogeneously, owing to the differences in underlying host conditions and immune responses. Although Toll-like receptor 2 (TLR2) is important in recognizing S. aureus, its function during S. aureus infection remains controversial. We aimed to examine the association of TLR2 expression and associated cytokine responses with clinical SAB outcomes. Methods Patients from a prospective SAB cohort at two tertiary-care medical centers were enrolled. Blood was sampled at several timepoints (≤5 d, 6–9 d, 10–13 d, 14–19 d, and ≥ 20 d) after SAB onset. TLR2 mRNA levels were determined via real-time PCR and serum tumor necrosis factor [TNF]-α, interleukin [IL]-6, and IL-10 levels were analyzed with multiplex-high-sensitivity electrochemiluminescent ELISA. Results TLR2 levels varied among 59 SAB patients. On days 2–5, TLR2 levels were significantly higher in SAB survivors than in healthy controls (p = 0.040) and slightly but not significantly higher than non-survivors (p = 0.120), and SAB patients dying within 7 d had lower TLR2 levels than survivors (P = 0.077) although statistically insignificant. IL-6 and IL-10 levels were significantly higher in non-survivors than in survivors on days 2–5 post-bacteremia (P = 0.010 and P = 0.021, respectively), and those dying within 7 d of SAB (n = 3) displayed significantly higher IL-10/TNF-α ratios than the survivors did (P = 0.007). Conclusion TLR2 downregulation and IL-6 and IL-10 concentrations suggestive of immune dysregulation during early bacteremia may be associated with mortality from SAB. TLR2 expression levels and associated cytokine reactions during early-phase SAB may be potential prognostic factors in SAB, although larger studies are warranted.This study was supported by a research grant (13–2014-002) from Seoul National University Bundang Hospital (Seongnam, South Korea). The funder had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript

Geographic Variation in Advertisement Calls in a Tree Frog Species: Gene Flow and Selection Hypotheses

In a species with a large distribution relative to its dispersal capacity, geographic variation in traits may be explained by gene flow, selection, or the combined effects of both. Studies of genetic diversity using neutral molecular markers show that patterns of isolation by distance (IBD) or barrier effect may be evident for geographic variation at the molecular level in amphibian species. However, selective factors such as habitat, predator, or interspecific interactions may be critical for geographic variation in sexual traits. We studied geographic variation in advertisement calls in the tree frog Hyla japonica to understand patterns of variation in these traits across Korea and provide clues about the underlying forces for variation.We recorded calls of H. japonica in three breeding seasons from 17 localities including localities in remote Jeju Island. Call characters analyzed were note repetition rate (NRR), note duration (ND), and dominant frequency (DF), along with snout-to-vent length.The findings of a barrier effect on DF and a longitudinal variation in NRR seemed to suggest that an open sea between the mainland and Jeju Island and mountain ranges dominated by the north-south Taebaek Mountains were related to geographic variation in call characters. Furthermore, there was a pattern of IBD in mitochondrial DNA sequences. However, no comparable pattern of IBD was found between geographic distance and call characters. We also failed to detect any effects of habitat or interspecific interaction on call characters.Geographic variations in call characters as well as mitochondrial DNA sequences were largely stratified by geographic factors such as distance and barriers in Korean populations of H. japonica. Although we did not detect effects of habitat or interspecific interaction, some other selective factors such as sexual selection might still be operating on call characters in conjunction with restricted gene flow

Dry Electrode-Based Body Fat Estimation System with Anthropometric Data for Use in a Wearable Device

The bioelectrical impedance analysis (BIA) method is widely used to predict percent body fat (PBF). However, it requires four to eight electrodes, and it takes a few minutes to accurately obtain the measurement results. In this study, we propose a faster and more accurate method that utilizes a small dry electrode-based wearable device, which predicts whole-body impedance using only upper-body impedance values. Such a small electrode-based device typically needs a long measurement time due to increased parasitic resistance, and its accuracy varies by measurement posture. To minimize these variations, we designed a sensing system that only utilizes contact with the wrist and index fingers. The measurement time was also reduced to five seconds by an effective parameter calibration network. Finally, we implemented a deep neural network-based algorithm to predict the PBF value by the measurement of the upper-body impedance and lower-body anthropometric data as auxiliary input features. The experiments were performed with 163 amateur athletes who exercised regularly. The performance of the proposed system was compared with those of two commercial systems that were designed to measure body composition using either a whole-body or upper-body impedance value. The results showed that the correlation coefficient ( r 2 ) value was improved by about 9%, and the standard error of estimate (SEE) was reduced by 28%

La Petite presse : journal quotidien... / [rédacteur en chef : Balathier Bragelonne]

04 juillet 18701870/07/04 (A5,N1537)